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OPTIMUM QUANTISERS FOR A GAUSSIAN INPUT PROBABILITY DENSITY 
AND FOR THE MAGNITUDE-ERROR DISTORTION MEASURE 


ABSTRACT 

The parameters of non-uniform and uniform quantisers up to ten bits of quantisation, 
optimum for a Gaussian input probability and for the magnitude-error distortion criterion are 
computed 

Optimum quantisers must be understood as quantisers with minimum distortion. The 
numerical method used for the optimisation converges relatively rapidly. The comparison 
between optimum non-uniform quantisers and optimum uniform quantisers is made. 


PREFACE 

This paper is part of a thesis presented to the Faculty of the Graduate School of Cornell 
University (Ithaca, N-Y, U.S.A.) for the Degree of Master of Science (January 1974). The 
thesis is entitled ‘Digital methods for the estimation of the R.M.S. value of bandlimited 
singular Gaussian processes*. 

We had to compute quantisers with minimum distortion when the input probability was a 
Gaussian distribution and when the magnitude-error criterion was taken. Although the 
algorithm used converged relatively rapidly, we hope in publishing the parameters of such 
quantisers, that other users will be saved computation time. 


I. INTRODUCTION 

The digitising process of physical phenomena (mostly continuous functions of time, 
denoted x(t» consists of two parts: sampling and quantising (Figure 1 ). 

The process of sampling consists of observing the continuous functions only at discrete 
times if. The r/s may be distributed either uniformly or at random in [ r ^ r^l , where [r a , r^) 
is the record length. It follows that a set of samples is denoted: { x(r { ) } . 

A set of predetermined values having been defined, the process of quantising consists of 
rounding off the value of each sample to the closest value of the set. This is performed by a 
quantiser. 

Clearly, quantisation introduces an error. An attempt must be made to minimise this 
error by making the number of predetermined values as large as possible and, given this 
number, by choosing a suitable interval between these values. 

This paper is concerned with the computation of such ‘optimum’ intervals. 

The use of optimum quantisers is required in accurate digital measurement processes. 


x (/) quantized 



Figure I. Continuous function digitising 

2. DEFINITIONS 

A /if-level quantiser maps any real value of the input into one of rtf real values at the 
output x€(7f T". x ] is reproduced by the output L t where the Tf s are the quantisation 
thresholds and the L { s are the output levels (Figure 2). 

The performance of a quantiser can be measured by the distortion introduced between 
input and output and by the output entropy. If pix ) is the input probability density and 
pCx.j')* the distortion measure, the overall distortion D is: 


• The cost function pix.y) is a non-negative function which specifies the penalty of 
reproducing x by y. 
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NUMERICAL COMPUTATION CONSIDERATIONS 


where: 

7*1 

C^Probap-Prob {r, <*<?(+!( - / pM.dx 

T, 

We define a n^-bit uniform quantiser as a quantiser such that: 

1 ) the thresholds are equally spaced: 

\T M -T i \*AT, /* 1 n l -2 n f> t 

(We shall call AT the threshold increment of the uniform quantiser); 
i) the output levels are at the middle of the input ranges: 

T i+ T »\ 

Li ~ , / = 1 , .... n { . 


In data processing, one tries to minimise the distortion introduced by the quantisers. 
Thus, in what follows, optimising a quantiser will mean finding the Tfs and the Lfs such that 
D is minimum for the given p(x) and p(x,y). 


We consider in what follows 


1 

pix) = 

OsJIk 


exp [ - 


(x - p) 2 

1 

2 a 2 


(3) 


p(x,y ) s I x - y I 


(4) 


The Gaussian probability density is found in many problems and the magnitude-error 
distortion is well suited to the concept of the absolute error of a measurement. 


3. NUMERICAL COMPUTATION CONSIDERATIONS 

The programs were run on the mini-computer DEC P.D.P. 11/40 of which the main 
characteristics are: 
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- 1 6-bit word, 

- direct addressing of 1 6k-bit words (k * 1 024), 
floating point arithmetic, 

- ANSI-standard FORTRAN IV compiler. 

A) As the input probability density, (3), is symmetric about the mean m, optimum 
quantiser will be symmetric about n too. 

B) The mean of the Gaussian probability density is just a parameter which positions the 
density along the axis. We assume in what follows that the mean is zero; if not, we just 
translate the thresholds and the output of the quantiser. 

C) We are interested, in fact, in n^-bit quantisers. The number of levels is always even: nj 
= 2 n b ' 

D) Mathematically the support of the probability density is (-<*>, + »), but because of the 
finite representation of numbers in the computer, the support will be finite, say [-a, + a] , i.e., 
Prob ) x$ ( -a, + aj } - 0. 

E) As consequence of remarks A, B, C and D: 

1 ) a slightly different notation is used : 
the set of thresholds is: 

n l 

T t /= 1, ± 2, ... ,± — + 1 ; 

the set of output levels is: 

( i/. ' = *> * y); 

2) the midway threshold is always 0, T\ - 0; 

3) the extreme threshold is 7"(n//2) + 1 = a (Figure 3). In fact we do not have to worry about 
the actual value of a (it actually depends on the computer itself), we just assume in the 
numerical computation that 

Prob (x£ [ - T (n/ / 2 )+l+r (n/ / 2 )+i] ( = 0; 


4) we shall compute half quantisers, say for x > 0, i.e. compute the Tf s and the Lf s up to 
n l 

/- — ; 

2 



Figure 3. Numerical considerations on quant isen 


5) the practical expression for D is: 

D * 2 . £ / pU. £/) . p(jr) . djc 

/*! T ( 

6) The output entropy is: 

rt[l2 

H-- 2. I Q, . lotf «?,) 
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7) T t <L t ,i- 1, .... nj/2 

F) For the computation, we consider a unit variance; if the actual variance is o 2 , it 
suffices to multiply the Tf s, the L t ’s and D by o, the output entropy remaining the same. 

This is justified by the two following equalities: 


1 

Oy/ 2tr 


b x i 





i 

(\/2# 


b x 2 

/ jcexp(--^y)dx 



& 

f x exp (- — ) dx 

f 


4. OPTIMISATION 


4.1. NON-UNIFORM QUANTISER 


4. 1. 1. Ip ‘*w of what optimisation means in this context, the thresholds and the output 
levels must satL . ) tor 




rtf dD 
2 : 377 


0 and 


dD 

dL, 


-0 


For the magnitude-error distortion measure, (4), we obtain for 

/-1 31 : 


Lj Ti+\ 

2. J p(x ) . dx * / p(x) . dx 


(7) 


orij-p-' I jN’(r /+ |)+/><r / ))| 


(8) 
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OPTIMISATION 


For the fix) »nd the P~ ‘(x) functions we refer to the Append'*. The second condition is 
known as the conditional median requirement for the L{\ s. 

It has been pointed out 2> that for some pathological input probability densities these 
conditions are only necessary but not sufficient. On the basis of our numerical results we 
conjecture that this is not our case and that the T { s and Lf s satisfying (7) and (8) lead to an 
absolute minimum for D 

4.1.2. Computation 

A. We use the relaxation method 3 K The main steps of this method are: 

1 . Initial partition of the Tf s: 


T,:T, - 0 , 0 < r / < r <+ |,/-2 


The intial partition is arbitrary. 

2. Finding the L { s satisfying (8). 

3. Computation of the s satisfying (7). 

4. Repetition of steps 2 and 3 until stabilisation occurs (as explained below). 

B. When shall we stop the iterative process? 

In numerical methods there exist several stopping criteria: 

1 . Absolute or relative accuracy in the unknowns. 

2. A given number of steps. 

3. Stabilisation of the solution. 

Here we can stop when a new set j T t | or ( ) does not introduce a large variation in 
the value of D. Let us consider the actual value D ^ of the distortion. Writing (5) for (4), we 
find that D a is expressed by: 


n J 

2 t M 

D a ■ 2 . £ f 1 x - Li I . pix) . dx 
/-I T t 


which can be written: D a m D t + D c . with 

n J 

2 ^ t M 

D. ■ 2. T - J x. pix) . dx ♦ f x. pix) . dx 

/-i i r, i, 
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n J 

2 f l , 77 +. 

D c m 2 Y. LA / p(x ) . dx - / p{x ) . dx 
/■l l Tf Lj 

D t is the theoreticil expression for the distortion and the term D c is due to the fact that each 
is not exactly the conditional median. 

This offers us a stopping criterion which must occur after each complete iteration of the 
algorithm. We start with a set j 7y | , we compute the set ) , and then the new set j T t 1 . 
At this point one iteration is complete. 

We shall stop the algorithm when D c is a given fraction of D t . 

C. Algorithm. 

Referring to Figure 4, we find the algorithm clearly presented in Figure S. We define n(x) 
d 1 /^ 2 * exp(-x a / 2 ). 

We also compute the output entropy H. 

D. Results. 

The results are given in Table 1 for 1 < < 8 . 

In Figure 7 we have plotted log D versus n ^ and in Figure 8 , H versus n^. 

It proved impossible to determine quantisers with > 9, because the numerical 
approximation of the functions ft.r' and F l (x) produced oscillations in the computation. 
In Figure 9 we have plotted Ty versus / for th^h 5 6 - and 7-bit half quantisers. 



Figure 4. Computation notations for the optimisation. 







D * 2J) 


OPTIMISATION 


lt X *2 •«*£ 


«1 - 1 

,« a - — - 1 
2 


X x m n x . AT, Jr a »i» a .AT 

r, -/KA'.) . y a =n<jr a ) 

D = 2.Y x -Y 3 

PHi-/i 1 .(2^jr 1 )-^jr a )- i.o) 
PHIl */»|.(2ji l .y 1 -n a .y a ) 


*2 = 0 - -),**=(/- 0 

Jlf, =/. AT. JT a =/ a • A7\ * 3 =/ 3 • A T 

Y l =n(X l ),Y 1 =n(X 2 ), Y,=n(X 3 ) 

z>=D + ( 2 .r a - y 3 - y,) 

PHI * PHI + 1 2 .(2JUr a )-JUT|)-Jtf s )) 
phii = PHii + i a .(2i a .y a - 1 ,. y 3 - ly x ) 


AF1 = AT 



AT- ATI 


AT* A71 


Figure 6. Optimisation of uniform quantisers. 
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OPTIMISATION 


TABLE 1 

Parameters of the Optimum non-uniform Quantiser; 
Input Probability Density: N(0, 1) 
Distortion Measure: p( x, y) m \x-y\ 


NUMBER OF BITS: 1 


DISTORTION: Q.4735D00 -0.2575D-03 


ENTROPY: 0.1000D01 


THRESHOLDS 
0.0000D 00 


LEVELS 
0.C742D 00 


NUMBER OF BITS: 2 


DISTORTION: 0.2657D 00 + 0.1945D-04 


ENTROPY: 0.1977D01 


THRESHOLDS 
0.0000D 00 
0.8216D00 


LEVELS 
0.3773D 00 
0.1266D 01 


NUMBER OF BITS: 3 


DISTORTION: 0.1429D 00 + 0.8706D-05 


ENTROPY: 0.2944D01 


THRESHOLDS 
O.OOOOD 00 
0.4130D00 
0.8688D 00 
0.14S3D 01 


LEVELS 
0.2018D 00 
0.6243D 00 
0.1113D01 
0.1793D 01 


NUMBER OF BITS: 4 


DISTORTION: 0.745 5D4)1 + 0.41 28D-05 


ENTROPY: 0.391 5D 01 


THRESHOLDS 
0.000(H) 00 
0.2097D 00 
0.4256D 00 
0.6537D 00 
0.901 9D 00 
0.1182D 01 
0.152 ID 01 
0.1988D 01 


LEVELS 
0.1041D 00 
0.3 1 540 00 
0.5 35 8D 00 
0.7717D 00 
0.1032D 01 
0.1333D 01 
0.1709D 01 
0.2267D 01 


NUMBER OF BITS: 5 


DISTORTION: 03814D41 ♦ 0.3617D-04 


ENTROPY: 0.4894D 01 


THRESHOLDS 
O.OOOOD 00 
0.1027D00 
0.2069D 00 
0.3136D 00 
0.4239D 00 


LEVELS 
0.51 16D-01 
0.1543D 00 
0.2595D 00 
0.3678D 00 
0.4799D 00 
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NUMBER OF BITS: S 

DISTORTION: 03814D41 ♦ 0.3617D-04 

ENTROPY: 0.4894D 01 


THRESHOLDS 

LEVELS 

6 

0.5384D 00 

0.5968D 00 

7 

0.658 0D 00 

0.7192D 00 

8 

0.7837D 00 

0.8482D 00 

9 

0.9167D 00 

0.985 ID 00 

10 

0.1059D01 

0.1132D 01 

11 

0.1 21 2D 01 

0.1292D 01 

12 

0.1380D 01 

0.1468D 01 

13 

0.1569D 01 

0.1670D 01 

14 

0.1791D01 

0.191 ID 01 

15 

0.2067D 01 

0.2223D01 

16 

0.2462D 01 

0.2702D 01 

NUMBER OF BITS: 6 

DISTORTION: 0.1935EWH 

- 0.1726D-04 

ENTROPY: 0.5878D 01 


THRESHOLDS 

LEVELS 

1 

0.0000D 00 

0.2530D-01 

2 

0.5072D-01 

0.7614D-01 

3 

a 101 9D 00 

0.1276D 00 

4 

0.1537D 00 

0.1799D 00 

5 

0.2066D 00 

0.2333D 00 

6 

0.2606D 00 

0.2879D 00 

7 

0.3158D 00 

0.3438D 00 

8 

Q.3724D 00 

0.401 OD 00 

9 

0.4302D 00 

0.45 95 D 00 

10 

0.4894D 00 

0.5193D 00 

11 

0.5498D 00 

0.5804D 00 

12 

0.6116D00 

0.6428D 00 

13 

0.6746D 00 

0.7064D 00 

14 

0.7389D 00 

0.7715D00 

15 

0.8047D 00 

0.8379D 00 

16 

0.8719D00 

0.9058D 00 

17 

0.9407D 00 

0.9755D 00 

18 

0.101 ID 01 

0.1047D 01 

19 

0.1084D 01 

0.1 1 21 D 01 

20 

0.1159D01 

0.1198D01 

21 

0.1238D 01 

0.1278D 01 

22 

0.1320D 01 

0.1362D 01 

23 

0.1406D 01 

0.1451D 01 

24 

0.1498D01 

0.1545D 01 

25 

0tl596D 01 

0.1648D 01 

26 

0.1704D 01 

0.1760D 01 

27 

0.1822D 01 

0.1884D 01 

28 

0.1954D 01 

0.2025D 01 

29 

0.21 OSD 01 

0.2190D 01 

30 

0.2291D 01 

0.2393D 01 

31 

0.2527D 01 

0.266 ID 01 

32 

0.2873D 01 

0.3085D 01 
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NUMBER OF BITS: 7 


DISTORTION: 0.9861 D02 - 

0.5744D05 

ENTROPY: 0.6864D01 


THRESHOLDS 

LEVELS 


THRESHOLDS 

LEVELS 

1 

O.OOOODOOv 

0.9821 1X02 

2 

0.19681X01 

02954D-01 

3 

0.3951D-01 

0.4948D-01 

4 

0.5961D-01 

0.69751X01 

5 

0.801 10-01 

0.9047D-01 

6 

0.101 ID 00 

0.1117D00 

7 

0.1227D00 

0.1336D 00 

8 

0.1449D 00 

0.1561D 00 

9 

0.1678D00 

0.1794D00 

10 

0.1915D 00 

0.2035D 00 

11 

0.2160D00 

0.2284D 00 

12 

0.241 3D 00 

0.2542 D 00 

13 

0.2675D 00 

0.2808D 00 

14 

0.2945 D 00 

0.3083D 00 

IS 

0.3225D 00 

0.3366D 00 

16 

0.3512D 00 

0.3658D00 

17 

0.3808D 00 

0.3958D 00 

18 

0.411 3D 00 

0.4267D 00 

19 

0.4425D 00 

0 4583D00 

20 

0.4745D 00 

0.4906D 00 

21 

0.5072D 00 

0.5237D 00 

22 

0.5405D 00 

0.5574D 00 

23 

0.5745D 00 

0.5917D 00 

24 

0.6091 D 00 

0.6266D 00 

25 

0.6443D 00 

0.6620D 00 

26 

0.6799D 00 

0.6978D 00 

27 

0.7160D00 

0.7341 D 00 

28 

0.7524D 00 

0. 7708 D 00 

29 

0.7893D 00 

0.8078D 00 

30 

0.8265D 00 

0.845 ID 00 

31 

0.8640D 00 

0.8828D 00 

32 

0.9017D 00 

0.9207D 00 

33 

0.9398D 00 

0.9588D 00 

34 

0.9781D 00 

0.9973D 00 

35 

0.1017D 01 

0.1036D 01 

36 

0.1055D01 

0.1075D01 

37 

0.1095D 01 

0.U14D 01 

38 

0.1134D01 

0.1154D01 

39 

0.1174D01 

0.1194D 01 

40 

0.1214D 01 

0.1234D 01 

41 

0.1255D 01 

0.1276D01 

42 

0.1296D 01 

0.1317D 01 

43 

0.1339D01 

0.1360D 01 

44 

0.1382D 01 

0.1403D 01 

45 

0.1425D 01 

0.1448D 01 

46 

0.1471D 01 

0.1493D 01 

47 

0.1517D 01 

0. 1 541 D 01 

48 

0.1565D 01 

0.1589D01 

49 

0.1615D 01 

0.1640D01 

50 

0.1667D01 

0.1693D 01 

51 

0.1721D 01 

0.1749D01 

52 

0.1778D 01 

0.1808D 01 

53 

0.1839D 01 

0.1870D01 

54 

0.1903D 01 

0.1936D01 

55 

0.1972D 01 

0.2006D01 

56 

0.2046D 01 

0.2085D 01 

57 

0.2127D 01 

0.21 69D 01 

58 

0.2216D01 

0.2263D 01 

59 

0.2316D01 

0.2369D 01 

60 

0.2429D 01 

0.2490D 01 

61 

0.2562D 01 

0.2633D 01 

62 

0.2722D 01 

0.281 ID 01 

63 

0.2931 D 01 

0.305 ID 01 

64 

0.3243D 01 

0.3435D 01 

NUMBER OF BITS: 8 

DISTORTION: 0.5208D-02 - 

0.1927D-06 

ENTROPY: 0.7815D01 


THRESHOLDS 

LEVELS 


THRESHOLDS 

LEVELS 

1 

O.OOOODOO 

0.3086D-02 

2 

0.61991X02 

0.93031X02 

3 

0.1 243 EM) 1 

0.1 5561X01 

4 

0.1872EX01 

0.21881X01 

5 

0.2509CM)1 

0.28301X01 

6 

0.3158D-01 

0.34851X01 

7 

0.3819D-01 

0.4154D-01 

8 

0.44971X01 

0. 48 40 EM) 1 

9 

03 193D-01 

0.55451X01 

10 

Oi 9081X01 

0.627 1D01 

11 

0.6646DO1 

0.70201X01 

12 

0.74071X01 

0.77941X01 

13 

0.8194D-01 

0.8594D-01 

14 

0.90091X01 

0.94231X01 

15 

0.9852DO1 

0.1028D 00 

16 

0.1073D00 

0.1117D00 

17 

0.1 163D00 

0.1209D00 

18 

0.1257D00 

0.1305D 00 
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IS 


NUMBER OF BITS: 8 

DISTORTION: 0.5208D-02 

- 0.1927D-06 

ENTROPY: 0.781 5D 01 



THRESHOLDS 

LEVELS 


THRESHOLDS 

LEVELS 

19 

0.1354D00 

0.1404D 00 

20 

0.1455D 00 

0.15O7D00 

21 

0.1560D 00 

0.1613D 00 

22 

0.1668D 00 

0.1724D00 

23 

0.1781D 00 

0 1838D 00 

24 

0.1897D 00 

0.1956D 00 

25 

0.201 7D 00 

0.2078D 00 

26 

0.2142D 00 

0. 2 205 D 00 

27 

0.2270D 00 

0.2335D 00 

28 

0.2403D 00 

0.2470D 00 

29 

0.2 5 40 D 00 

0.2609D 00 

30 

02681D00 

0.2752D00 

31 

0.2826D 00 

0.2899D 00 

32 

0.2975D00 

0.305 ID 00 

33 

0.3129D00 

0.3206D 00 

34 

0.3286D 00 

0.3366D 00 

35 

0.3448D00 

0.3530D 00 

36 

0.3614D00 

0.3697D 00 

37 

0.3783D 00 

0.3869D 00 

38 

0.395 6D 00 

0.4044D 00 

39 

0.4133D00 

0.4223D 00 

40 

0.4314D00 

0.4405D 00 

41 

0.4498D 00 

0.4591 D 00 

42 

0.4685D 00 

0.4780D 00 

43 

0.4876D 00 

0.4972D 00 

44 

0i069D00 

0.5167D00 

45 

0.5266D00 

0.5365D 00 

46 

0.5465D 00 

0.5565D 00 

47 

0.5667D 00 

0.5768D 00 

48 

0.5871D 00 

0.5973D 00 

49 

0.6077D 00 

0.6181D 00 

50 

0.6286D 00 

0.6390D 00 

51 

0.6496D 00 

0.6602D 00 

52 

0.6708D 00 

0.6815D00 

53 

0.6922D00 

0.7029D 00 

54 

0.7137D 00 

0.7245D 00 

55 

0.7353D 00 

0.7462D 00 

56 

0.757 ID 00 

0.7680D 00 

57 

0.7789D 00 

0.7899D 00 

58 

0.8008D 00 

0.8118D 00 

59 

0.8228D 00 

0.8338D 00 

60 

0.8448D 00 

0.8559D 00 

61 

0.8669D 00 

0.8779D 00 

62 

0.8890D 00 

0.9000D 00 

63 

0.911 ID 00 

0.9221 D 00 

64 

0.9332D 00 

0.9442D 00 

65 

0.9553D 00 

0.9663D 00 

66 

0.9773D 00 

0.9884D 00 

67 

0.9994D 00 

0.1010D 01 

68 

0.1021D 01 

0.1032D 01 

69 

0.1043D 01 

0.1054D 01 

70 

0.1065D 01 

0.1076D 01 

71 

0.1087D 01 

0.1098D01 

72 

0.1109D01 

0.1120D01 

73 

0.1130D01 

0.1 1 41 D 01 

74 

0.1152D01 

0.1163D01 

75 

0.U74D01 

0.U84D01 

76 

0.1195D01 

0.1206D 01 

77 

0.1216D 01 

0.1227D 01 

78 

0.1238D 01 

0.1248D 01 

79 

0.1259D 01 

0.1269D 01 

80 

0.1280D 01 

0.1290D 01 

81 

0. 1 301 D 01 

0.131 ID 01 

82 

0.1322D 01 

0.1332D 01 

83 

0.1343D 01 

0.1353D 01 

84 

0.1364D 01 

0.1374D 01 

85 

0.1384D 01 

0.1395D0I 

86 

0.1405D01 

0.1415D 01 

87 

C.1426D 01 

0.1436D 01 

88 

0.1446D 01 

0.1457D 01 

89 

0.1467D 01 

0.1477D 01 

90 

0.1487D01 

0.1498D 01 

91 

0.1508D 01 

0.1519D 01 

92 

0.1529D01 

0.1539D01 

93 

0.1550D01 

0.1560D 01 

94 

0.1 571 D 01 

0.1 58 ID 01 

95 

0.1592D 01 

0.1602D01 

96 

0.161 3D 01 

0.1624D 01 

97 

0.1635D 01 

0.1646D 01 

98 

0.1657D01 

0.1668D 01 

99 

0.I679D 01 

0.1690D 01 

100 

0.1702D 01 

0.1713D 01 

101 

0.1725D01 

0.1737D 01 

102 

0.1749D01 

0. 1 761 D 01 

103 

0.1773D 01 

0.1786D01 

104 

0.1799D 01 

0.181 ID 01 

105 

0.1825D01 

0.1838D 01 

106 

0.1852D01 

0.1866D 01 

107 

0.1880D 01 

0.1894D 01 

108 

0.1909D 01 

0.1924D 01 

109 

0.1940D 01 

0.1956D01 

110 

0.1972D 01 

0.1989D 01 

111 

0.2006D 01 

0.2024D01 

112 

0.2042D01 

0.2061 D 01 

113 

0.2080D 01 

0.2100D 01 

114 

0.2121D 01 

0.2141D 01 
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OPTIMISATION 


NUMBER OF BITS: 8 


DISTORTION: 0.S208D4J2 

- 0.192 7D-06 

ENTROPY: 0.781 5D 01 



THRESHOLDS 

LEVELS 


THRESHOLDS 

LEVELS 

US 

0.2164D 01 

0.2186D01 

116 

0.221(H) 01 

0.2234D 01 

117 

0.22S9D 01 

0.2285D 01 

118 

0.231 3D 01 

0.2340D 01 

119 

0.2371 D 01 

0.2401 D 01 

120 

0.2434D 01 

0.2467D01 

121 

0.2S04D01 

0.2S41D01 

122 

0.2582D 01 

0.2623D 01 

123 

0.2670D 01 

0.271 7D 01 

124 

0.2771D01 

0.2826D 01 

125 

02 89 ID 01 

029S6D01 

126 

0.3037D 01 

0.3U9D01 

127 

0.3229D 01 

0.3340D01 

128 

0.3519D 01 

0.3699D 01 


4.2. UNIFORM QUANTISER. 


Uniform quantisers have been defined previously. 


4.2.1. Again, for a symmetric input probability p(x), the overall distortion/) is expressed by: 


n J-\ 

2 l. AT , 

Z>* 2{J / p[x, (/--). AT] . p(x) . dx + 

/*i (/-i).Ar 2 

+ f p(x, — • AT) . p(x) . dx } 

Q - DAT 


The optimisation problem is much easier than previously because AT is the only 
parameter. It must satisfy: d/)/d(AD = 0 which can be written for the absolute error 
distortion measure as follows: 


i i 

i 

/*! 2 


(/- 1/2). AT 
[ / p(x) . dx 

(/ — 1 ) .AT 


i. AT 

f p(x) . dx 1 
(l- M2). AT 


+ 


+ [ f p(x) .ix- f pix) • d* ] * o 

(H DAT 

2 2 


( 10 ) 
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4.2.2. Computation 

A. We use the Newton-Raphson method. 

Let 9 be equation ( 1 0). 

The problem consists in finding [AT] * such that 
9([Ar]*)*0 

The Newton-Raphson iterations are defined by: 


[An k+1 


. *([An k ) 

[Ar ]k 

*’(lAr] k ) 


The main characteristic of this method is its quadratic convergence, which means that, 
near the result [AT]*, the number of correct digits in [Ar] k doubles with each iteration. If 
this behaviour is not observed, we can be assured that the method has not been implemented 
correctly. Moreover, this offers us a stopping criterion; we stop the iteration process when the 
relative change in [AT] k is negligible (less than 10" 8 ). 

We again computed H , the quantiser output entropy, but its calculation does not appear 
in the program flow chart. 



Figure 7. Distortion versus number of quantisation bits 
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OPTIMISATION 



Figure 8. Output entropy versus number of quantisation bits. 


TABLE 2. 

Parameters of the Optimum Uniform Quantiser 
Input Probability Density: N(0, 1), 
Distortion Measure: p(x, y) m \x - y\ 


n b 

£sT 

D 

H 

1 

0.1349D 01 

0.4732D 00 

0.9999 

2 

0.83500 00 

0.2669D 00 

1.973 

3 

0.4875U 00 

0.1474D 00 

2.904 

4 

0.2759D 00 

0.8042D4)1 

3.806 

5 

aiS31D00 

0.435004)1 

4.700 

6 

0.8368 D*01 

0.233504)1 

5.560 

7 

0.4524001 

0.1245001 

6.495 

8 

0.242404)1 

0.6600002 

7.403 

9 

a 128904)1 

0.348004)2 

8.318 

10 

0.681404)2 

0.1826002 

9.241 
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B. Flow chart of the program, see Figure 6. 

C. Results. 

The optimum A T and the corresponding D and H are given in Table 2 for 1 < < 10. 

We have plotted log(D) versus n ^ in Figure 7 and H versus n ^ in Figure 8. 


S. COMPARISON OF NON-UNIFORM AND UNIFORM QUANTISER 
For a given number of bits, we have: 

1. The distortion of a uniform quantiser is slightly greater than that of the non-uniform 
quantiser (Figure 7). 

2. The output entropy of the uniform quantiser is slightly smaller than that of the 
non-uniform quantiser (Figure 8). 

In both cases, the output entropy is close to its maximum, // max s n b (bits), which 
means that the output levels are almost equiprobable. 

In Figure 9 we have plotted the thresholds versus their rank / for both types of the 4 
5 -, 6- and 7-bit half quantisers. For the non-uniform quantiser, A T* ~kT^.\ -7/) t as i t 
which explains why the probability of the output levels is quasi-uniform. In Figure 10, we have 
plotted the probabilities, Q it of the output levels L i versus t for both types of the 7-bit half 
quantiser. 



Figure 9. Thresholds verms rank. 
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Figure 10. Output probabilities versus rank. 

Although the non-uniform quantisers have slightly better performances (lower distortion, 
higher output entrop v ) than the uniform ones, the uniform quantisers are the only quantisers 
practically available: - ying AT is essentially the same as varying the gain of a signal amplifier 
before quantisation. 
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APPENDIX 


A. 1 x t* 

1 ) nx)^— / exp (- 1_) . df 

V* f -M * 


b) x m P~ l Cv). That it, P~\ computet the value x when y ■ Prob ({<*)■ Fix) it given. 


These two function! are not available in the ttandard P.D.P. 1 1/40 software. We use modi- 
fied numerical approximations 4 *. 

«) fW- ^ (1 -erf(— £r),*<0 

2 y/2 


i- ( 1 -p erf x > 0 

2 y/2 


by: 


The error function itself it approximated numerically 


erf*(x) - 1 - ( £ W) -T- exp (- x 2 ) 

h\ v* 


where 17 


1 


1 + cx 


with 


c - 0.3275911 

ai - 0.225836846 

a 2 - -0.252128668 


a 3 - 1.259695130 

a4 - -1.287822453 
a s - 0.940646070 


b) For y > 0.5 we have the following approximations: 

i 

• /*0 , 

[P~ 1 (y)l* "i? where »?■ V - y )~ 2 with 

lb t rf 

M) 


•0 • 

2.515517 

ho - 

1.0 

# 1 ■ 

0.802853 

b l - 

1.432788 

•2 * 

0.010328 

b 2 " 

0189269 



b 3 - 

0.001308 



